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ABSTRACT 



An adequate evaluation of the Program for Learning 
in Accordance with Needs (PLAN) necessitates consideration of all the 
PLAN goals and the extent to which they have been attained. Two sets 
of goals are identified. Eleven specific goals for each student, 
which involve the acquisition of a wide range of information, skills, 
and abilities in addition to personal development are listed and 
techniques fci; measuring success in attaining them are suggested. 

Five general PLAN goals are presented in the appendix. In this 
report, evaluation of the attainment of goals in grades 1, 2, 5, and 
6 is achieved by comparing scores on standardized tests administered 
at different times for PLAN students and for groups of students frcm 
traditional classrooms, designated as controls. The data used for 
1 £67-68 was obtained from the test files of the cooperating schools, 
while data for 1968-69 was supplemented by test scores from a PLAN 
supported testing program. Comparisons were made by PLAN teachers for 
all students to whom the tests were administered and for those 
students whc had scores on both a given pretest and a given posttest. 
Problems in the interpretation of the data are discussed. As a result 
of the comparison, it is generally concluded that when grade 
placement and growth are considered, the PLAN students perform as 
well as or better than the controls, despite the initial problems of 
a new program. It is also noted that there is a tendency for a 
student to do better the longer he is in the program. (PR) 
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EVALUATION DATA AND THEIR USES IN AN INDIVIDUALIZED EDUCATION PROGRAM 



Since its inception, PLAN has been a data oriented program of individualized 
education. As might be expected, initial evaluations were formative in nature, 
supplying information needed for the improvement and refinement of the system. 

An adequate evaluation of PLAN can be made only if all of the various PLAN goals 
are considered. The major uses of evaluation data are, therefore, oriented towards 
determining the extent to which the goals have been attained. To date, there has 
not been an opportunity to evaluate the program's success in attaining all of the 
goals that have been identified, nor have all of the required measurement devices 
been developed. 

The Goals of PLAN 

Two sets of goals for PLAN have been identified. The general goals are shown 
in the Appendix. PLAN goals for each student, with some indication as to how 
success in attaining them may be measured, are as follows: 

1. To assist each student to acquire information about available choices 
regarding occupational roles, leisure time activities, and citizenship 
responsibilities. 

' a. Included is: knowledge about the required education and abilities 

needed for various occupations; learning about educational and 
occupational opportunities and citizenship roles; and the nature 
of other activities involving self-expression, appreciation, and 
personal realization and satisfactions, 
b. How well this goal is attained can be evaluated in part by use of 
appropriate PLAN guidance module tests. In addition, three informa- 
tion tests are needed covering: careers and occupations; leisure, 

avocational, cultural activities; and citizenship roles. 

2. To assist each student to acquire information about individual differences, 
the nature of the learning and change process, and the development of 
abilities, interests, and values. 

a. Appropriate module and guidance tests can be used to evaluate student 
attainment of this goal. 

3. To assist each student to acquire information about his own abilities, 
interests, values, and other characteristics. 

a. The student should understand his potentials in light of item 2 above. 

b. Scores on the PLAN constructed Developed Abilities Performance Test, 
General Information Test, and other scales can be determined. In 
addition, self-appraisal procedures and tests should be developed. 
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4. To assist each student to formulate goals based on his interests and values. 

a. Satisfactions should also be considered. 

b. Evaluations should include finding out what the student likes to do, 
and how he spends his time. 

5. To assist each student to develop skills in planning and personal decision- 
making related to the formulation and attainment of his goals. 

a. The student should be able to plan wisely and make good decisions using 
all available facts and probabilities. 

b. To test decision-making, a closed situation can be used where all the 
necessary facts are given and the student's ability to plan is 
evaluated. Profiles from Project TALENT can be evaluated by the 
student. Career games should also be developed. 

6. To assist each student to manage his own personal development. 

a. A criterion for this goal is needed. Self-management skills should 
be considered. 

7. To assist each student to take responsibility for carrying out his indivi- 
dual development, and to develop favorable attitudes towards learning. 

a. The major concern is with how well the student can carry out his 
program as planned. Self-responsibility, self-reliance, and self- 
motivation are component parts. 

b. Typical behavior should be measured whereby the student demonstrates 
his ability to carry out his program independent of his teachers and 
parents. A standardized assignment could also be used. The information 
that the student asks people for could be determined. Carrying through 
on assigned and agreed upon tasks with responsibility and effort is one 
of the areas covered in the Performance Record for Personal and Social 
Development (Flanagan, 1956a). 

8. To assist each student in his personal development and adjustment. 

a. Self-concept, initiative, and integrity are included. 

b. Related areas in the Performance Record (Flanagan, 1956a) are: showing 

independence, initiative, and originality; and showing honesty and 
integrity. The High School Social Situations Test (Flanagan, 1956b) 
can be used to record behavior in the area of showing strength of 
character and integrity. Information could also be collected on 
absentee rates, referrals for counseling assistance, and the number 

of legal troubles that a student has. 

9. To assist each student to develop good patterns of social behavior. 
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a. This involves social adjustment, leadership, helping others, sharing, 
sensitivity, group orientation, and adaptation to rules and conventions. 

b. Teacher or student observations of behavior in standardized situations 

can be used to record appropriate and inappropriate behaviors in the 
areas of: dealing effectively with difficult situations; showing 

consideration for the feelings of others; contributing to group 
interests and goals; and dealing effectively with rules, conventions, 
and teacher suggestions. All but the latter are also included in the 
High School Social Situations Test (Flanagan, 1956b), which also covers 
leadership. 

10. To assist each student to develop his basic skills and abilities. 

a. This goal pertains to long-range abilities and skills, rather than 
short range achievement objectives. Ingenuity is related. 

b. Scores on the Developed Abilities Performance Test and on standardized 
tests can be used to evaluate student attainment of this objective. 
Procedures should also be developed so that test results can be 
reported in terms of situations meaningful to the student. 

11. To assist each student to acquire and retain knowledge, concepts, 

principles, and skills, and to acquire the techniques needed in applying 

them to new problems. 

a. This goal covers the content of traditional instruction, plus learning 
how to learn and applying what is learned. 

b. The attainment of this goal can be evaluated by use of the module 
tests, PLAN prepared achievement tests, and standardized tests. 

Measures of retention should be developed. An evaluation using 
academic grades might also be useful. 

c. Whether or not the student learns new skills and knowledge at the 
best difficulty level and rate for him can be evaluated by deter- 
mining the number of new educational objectives that he masters in a 
given period of time. 

d. The amount of time required to achieve specific educational objectives 
can be used as an index of whether or not the methods and materials 
used by a student are the most efficient for him. 

Comparisons of PLAN and Control Students 
Success in attaining two of the goals of PLAN can be evaluated by comparing 
scores on standardized achievement tests for PLAN students and for groups of 
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students in traditional classrooms that have been designated as Controls. Such 
comparisons have recently been completed for both the 1967-8 and 1968-9 school 
years. Data used for 1967-8 were obtained from the test files of the cooperating 
schools, while data for 1968-9 were supplemented by test scores from a PLAN 
supported testing program. Comparisons were made by PLAN teacher for all students 
to whom the tests were administered. Comparisons were also made by PLAN teacher 
using those students who had scores on both a given pretest and a given posttest, 
using various pre- and posttests as the data were available. 

The data presented in Tables 1 through 4 were obtained by summarizing the 
results by grade level for those pairs of pretests and posttests with the largest 
number of students. As necessary, adjustments were made for slight variations 
in testing dates. For grades 1 and 2, data were used only for those schools that 
reported scores on all of the subtests for both the selected pretests and the 
selected posttests. For grades 5 and 6, to the extent appropriate data were used 
only for those schools that reported scores on sub tests in common between the 
selected pre- and posttests. As a result the same students are included in both 
the pre- and posttests for any given year and grade level. 

In interpreting the data the following items should be noted. 

1. Due to the relatively large sample sizes, most PLAN-ControI differences 
are statistically significant (including some grade equivalency score 
differences of .1 or one month). Such differences are not assumed to be 
of practical significance so t^ test results are not shown on the tables. 

2. One problem in interpreting the relative performance of the PLAN and 
Control students is readily apparent: in most cases the two groups were 
not comparable on the pretests administered when the students entered 
PLAN. An attempt had been made to select PLAN students randomly from 
among all students at a given grade level at each school. Either the 
rest of the class, or a random sample thereof, was to serve as Controls. 
However, where random selections were made, final choices regarding 
participation in PLAN were made by the schools from among the students 
selected after consultation with the parents involved. Where Control 
schools were designated rather than Control students at the same school, 
there was no way in which the comparability of the two groups could be 
assured. Part of the problem of the evaluation cf the progress of PLAN 
students under these circumstances is that it is not known whether the 
tendency is greater for students with higher achievement to stay ahead, or 
those behind to catch up more, assuming equal initial abilities. Statis- 
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tical or other procedures to attempt to adjust for pretests differences 
between PLAN and Control should be tried. 

3. The pros and cons of using standardized test data to evaluate a program 
of individualized education have been discussed elsewhere (e.g., Wright, 
1969; I.P.I., 1968). Interestingly, Research for Better Schools has 
summarized a number of studies (A Progress Report , 1969) that compared 
the mathematics achievement of Individually Prescribed Instruction and 
Control Students using standardized tests such as the Iowa Test of Basic 
Skills, Metropolitan Achievement Test, and Stanford Achievement Test. 

No statistically significant differences were found between the two 
groups of students. In both PLAN and I.P.I., stj«ents do not proceed to 
new skills until they have achieved mastery of the units on which they 
are working. They may not, therefore, compare favorably on standardized 
tests with students in traditional classrooms that have been exposed to 
(but not necessarily mastered) a greater number of skills. 

4. Growth scores should be interpreted cautiously. Some statisticians have 
recommended that such difference scores not be used (e.g., Cronbach & 
Furby, 1970), while others (e.g.. Carver, 1970) have taken a more liberal 
vi ew . 

As seen in Table 1, the pretest for 1968-9 grade 1 students was the Metro- 
politan Readiness Test. PLAN students had larger mean scores on all sub tests. 

The Spring posttest was the Stanford Achievement Test Primary I battery. PLAN 
means were about equal or greater than those for the Controls except on Spelling, 
where the difference was about one month. All means for both groups were above 
grade placement at time of testing. 

Data for 1968-9 grade 2 students are shown in Table 2. The 1967-8 pretest, 
administered>.'hjle the children were in Kindergarten, was a PLAN developed Kinder-, 
garten Rating Foritii. The children selected for PLAN had higher readiness scores 
than the Controls, especially for Reading. On the S.A.T. Primary I battery used 
at the end of grade 1, PLAN means were somewhat larger than those for the Controls 
except on Spelling, where the two groups were about equal. Both groups were above 
grade placement on all subtests. 

PLAN and Control were generally comparable on the 1968-9 pretest for those 
students with scores on the grade 2 pre- and posttests. Posttest scores favored 
the Controls on some subtests, especially Word Study Skills and Science and Social 
Studies. On Arithmetic Computation the PLAN students were about one month below 
grade placement, while the Controls were at grade placement. All other means were 
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above grade placement. For the subtests in common between the pre- and posttests, 
PLAN showed greater growth than the Controls except on Word Ltudy Skills, where 
neither group had the expected 6 months increase. The greatest growth was 8 months 
by the PLAN group on Paragraph Meaning. 

The results for grade 5. are shown in Table 3. PLAN means were greater than 
those for the Controls on the 1968-9 pretest, the S.A.T. Intermediate I battery, 
except for Arithmetic Computation. Differences as large as 6 months were found 
between the two groups. On the posttest, the S.A.T. Intermediate II battery, the 
PLAN-Control differences are about equal to or greater than those found on the 
pretest. PLAN students generally showed somewhat greater growth during the year 
than the Controls. For some subtests, especially Word Meaning and Social Studies, 
neither group had the expected 6 months growth. This may be a function of 
differences in the norming of the two batteries. PLAN students grew 9 months in 
Language and 7 months in Arithmetic Application. The Controls were below grade 
placement on five subtests, while PLAN students were below on one. 

Table 4 shows the data for 1968-9 grade 6 students. The 1967-8 pretest, 
administered at the end of grade 4, was the Iowa Test of Basic Skills. The PLAN 
students were 5 months to one year ahead of the Controls on all subtests. The 
I.T.3.S. was also used as the 1967-8 posttest at the end of grade 5. PLAN 
students were again ahead of the Controls, but the differences were generally 
less than on the pretest. Growth for the PLAN students was somewhat less than 
that for the Controls, although the PLAN students were above expected grade place- 
ment on all subtests. 

The S.A.T. Intermediate II battery was used at the beginning of grade 6 in 
1968-9. Although the means for the PLAN students are larger than those for the 
Controls, most of the differences are relatively small and non-significant. On 
the posttest, an alternate form of the S.A.T. Intermediate II battery, PLAN had 
higher means on all subtests except Arithmetic Computation and Arithmetic Concepts, 
where the latter difference was about 2 months. Growth for PLAN students was 
greater than that for Controls on six of the nine subtests. Neither group showed 
expected growth on some subtests. The Control students were below grade placement 
on five subtests, while the PLAN students were only below on three of the nine. 

The data presented for the four grade levels is obviously difficult to inter- 
pret since the PLAN and Control groups were not comparable on the pretests. Gen- 
erally, however, it appears that the PLAN students at least held their own when 
grade placement and growth are considered. This finding is encouraging since there 
were the usual start-up problems expected of a new program, and materials were 
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often not available for the brighter students to progress to the curriculum of the 
next higher grade level. There is also some tendency for students to do better 
the longer that they are in PLAN. This finding will bear looking into in the 
future. 
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Grade placement at time of testing: 6.8. 
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The General Goals of PLAN 
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1. To make available an individualized education program better adapted to the 
requirements of each student than existing programs. 

a. Specifically, PLAN proposes to broaden the focus of education to include: 

(1) preparation for an occupation or advanced education leading to an 
occupational role:; (2) the development of cultural and personal interests, 
appreciations, insights, and skills as a basis for identifying and partici- 
pating in activities which are deeply satisfying to the student in his 
leisure time; and (3) preparation for assuming his responsibilities as a 
citizen. It is the aim of PLAN that students in this educational program 
will make more progress with respect to these important long-range goals 
than do students in current conventional educational programs. 

b. Success in attaining this general goal will be evaluated in terms of success 
in attaining the more specific goals. Evaluation should be in terms of the 
degree to which PLAN enables each individual student to meet his needs. 

2. To provide for the use of learning materials and instructional procedures that 
enable each student to acquire information, abilities, skills, and behaviors 
most efficiently. 

a. PLAN should avoid the waste of time, characteristic of many current educa- 
tional programs, on materials already known to the student or on materials 
which are too difficult to enable him to learn. 

b. Through the empirical evaluation of TLU's and the monitoring of retention 
and the ability to generalize, the efforts devoted to review and new 
applications can be optimized for the student. This efficiency can be 
evaluated in terms of the increased achievement of the students in terms 
of their educational objectives through the use of the achievement tests 
and the Developed Abilities Performance Tests. 

3. To provide a practical program which can be immediately implemented in nearly 
all school districts. 

a. This goal implies the achievement of a high degree of flexibility in the 
program with respect to community, administrative, teacher, and student 
requirements. It also implies a reasonable per pupil cost. 

4. To conduct required formative evaluations that give indications as to the 
operation of the system, and to conduct research into aspects of human learning, 
a. The concern here includes, but is certainly not restricted to, the develop- 
ment and evaluation of testing instruments and procedures, the development 
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of norms and standards, and the evaluation of the rules and algorithms for 
program of studies determination, TLU matching, etc. 
b. Among other instruments the Teacher Observation Scale and Student Observation 
Scale (Lipe & Steen, 1970) should be useful. 

5. To have equipment and procedures which significantly contribute to students 
formulating appropriate goals and achieving them. 

a. This goal relates to system and process procedures. Information about 
materials and students should be immediately available for whatever use to 
which it might be put. 

b. Central to this goal is the evaluation of the adequacy of the computer 
system, and reports about the utilization of the system. 
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